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Abstract 

Two elements, x and y, are separated by a set S if it contains exactly one of x and y. We prove 
that any set of n points in general position in the plane can be separated by 0(n log log n/ log n) 
convex sets, and for some point sets f2(n/logn) convex sets are necessary. 

1 Introduction 

We say that a set S separates elements x and y, if exactly one of x and y is in 5. Given an underlying 
set X, a family T of its subsets is called separating, if for any x,y £ X, x / y, there exists an F € T 
which separates them. 

Separating families are important tools in search theory. Suppose there is an unknown defective 
element in X, and we can test subsets of X if they contain the defective element or not. We want to 
choose a family of sets in advance (non-adaptively), such that testing all of its members determines 
the defective element. It is not hard to see that the family satisfies this property if and only if it is 
separating. The usual goal is to test as few sets as possible, i.e. find a separating family of minimum 
cardinality. 

It is clear that a separating family of X, \X\ = n, contains at least [logn] sets, since k subsets of 
X divide it into at most 2 k parts. (All logarithms in this paper are of base 2.) 

On the other hand, we can represent the elements of X by — 1 sequences of length k = [log n \ . 
Then, for 1 < k < m, let Ai denote the set of elements with 1 at coordinate i. Then the sets Ai form a 
separating family. 

Another well-known observation is the following, orig inally due to Bondy [B72], see also [W09]. 

Observation 1.1. Let J 7 be a minimal separating family (in the sense that no proper subfamily of it is 
separating). Then |-7-*| < n — 1. 
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There are several different versions of this simple concept, for a survey see [DH94]. An obvious 
idea is to consider adaptive algorithms, where we test only one set at a time, and choose the next set 
knowing the result of the previous test. Or one can have more defective elements, different types of 
tests, or errors in the results of the tests. One of the most studied generalizations is that not every 
subset can be asked. Instead, we are given a family A of subsets of X, and we can only test its members. 
A well-known example for this is to find the defective coins, or to sort a finite set, using only pairwise 
comparisons. 

In this note, our underlying set X is a set of points in the plane, and we have certain geometric 
restrictions on the subsets we can ask. 

For a family A of planar sets and a point set X let Ax = {A n X\A G A}. For simplicity, we will 
call A separating (with respect to X) if Ax is separating. 

Definition. Let X be a set of n points in the plane, and let A be a family of planar sets. Let s(X,A) 
denote the size of the smallest subfamily A' Q A with the property that the family {^4 n X\A £ A'} is 
separating. If there is no such subfamily, then let s(X,A) = oo. 

Let s(n, A) be the maximum of s(X, A) over all n-element point sets X, and let s'(n,A) be the 
maximum of s(X, A) over all n-element point sets X in general position (that is, not three of its points 
are on a line). 

By Observation ll.lt for any family A, s(n, A) < n — 1 or s(n, A) = oo, and similarly, s'(n, A) < n — 1 
or s'(n, A) = oo. 

For most of the natural families of planar sets A, it is not hard (or sometimes trivial) to give a linear 
lower bound for both s(n,A) and s'(n,A), and in many cases we can determine their exact values. We 
only give two examples here. 

Theorem 1. Let % and T> denote the family of the halfplanes and discs, respectively. Then we have 

(i) s{n, U) = n-1, s'{n, U) = \n/2] , 

(ii) s(n,V) = s'{n,V) = \n/2\. 

The case when A is the family of convex sets seems to be the most interesting. 

Theorem 2. Let A denote the family of planar convex sets. Then we have 
(i)s(n,A) = \n/2\, 

and (ii) n/21ogn < s'(n,A) < 20nloglogn/logn. 

We prove Theorem Q] in Section [21 and Theorem [2] in Section [3j 

2 Some simple families of planar sets; Proof of Theorem [I] 

It is easy to see that both families are separating, for any point set, hence they contain separating 
subfamilies of cardinality at most n — 1. This implies by Observation 11.11 an upper bound of n — 1 in 
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each case. In fact, we can give a separating subfamily of size n — 1 directly for the hyperplanes. Assume 
without loss of generality that all points have different x-coordinates, (otherwise we slightly rotate the 
coordinate system) and let pi,P2, ■ ■ ■ ,Pn be the points, ordered according to their x-coordinates. Then 
let Hi, H2, ■ ■ ■ , H n -i be halfplanes such that Hi contains exactly pi,P2, ■ ■ ■ ,Pi of the points. It is clearly 
a separating family. 

Now let P be a set of n collinear points, pi,p2, ■ ■ ■ ,Pn, and let %{P) be a separating family of 
halfplanes. For any i, 1 < i < n, there is a halfplane Hi £ T~L{P) which separates pi and Pi+i, and 
these halfplanes are all different. Therefore, H(P) contains at least n — 1 halfplanes, consequently, 
s(n, %) = n — 1. 

Now we show the lower bound for s'{n,T-L). Let P be a set of n points, pi,pi, ■ ■ ■ ,p n , on a circle, 
ordered clockwise, and let T~L(P) be a separating family of halfplanes. For any i, 1 < i < n, there is a 
halfplane Hi £ H(P) which separates pi and Pi+i, and there is a halfplane H n £ ~H(P) which separates 
p n and p\. These are n halfplanes, and we counted a halfplane at most twice. Therefore, %{P) contains 
at least \n/2] halfplanes. 

Finally, we show that the upper bound holds for s'{n,T-L). Suppose that P is a set of n points in 
general position. We obtain a separating family S of [n/2] halfplanes by the following procedure. We 
can assume without loss of generality that n is even. 

Halfplane-Separate(P) 

Step 0. Let I be a line which has exactly n/2 of the points on both sides. Let Qo C P and Ro C P 
denote the points on the two sides of I. Let Hq be a halfplane whose bounding line is t. Let So = {-^0)7 
i = 1. 

Step i. Take the convex hull of QiU Ri. It has two edges that cross i, let e = q^i be one of them, 
Qi £ Qi, fi G Ri- Take a halfplane Hi that separates qi and from the rest of Qi and Ri . 

If i < n/2 — 1, then let Si+i = Si U {Hi}, let Qi+i = Qi \ {qi}, R1+1 = R% \ {fi}- Increase i by one, 
and go to Step i. 

Otherwise (for i = n/2 — I), let S = Si U {Hi}, and Stop. 

Clearly, S is a set of n/2 halfplanes. We claim that it separates P. Let p,p' £ P. If p = qi and 
p' = rj for some then Hq separates them. If p = qi and p' = qj, i < j, (or if p = ri and p' = rj, 
i < j), then Hi separates them. 

In the case of discs, the proofs are very similar. To show that s(n,T>),s'(n,T>) > [n/2], let P be a 
set of n points on a circle. We can argue exactly as in the case of halfplanes, any disc can separate at 
most two consecutive pairs, therefore we need at least [n/2] discs. 

To prove that [n/2] discs are always enough, we can use a procedure very similar to Halfplane- 
Separate(P). Observe, that in the case of discs, it works for any point set, we do not have to assume 
that the points are in general position. Therefore, we have s(n,T>) = s'(n,V) = [n/2]. 
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3 Convex sets; Proof of Theorem [2] 



Proof of part (i). The proof of the lower bound is again very similar to the previous proofs. Let P be 
a set of n points, pi,p%, ■ ■ ■ ,p n , on a line in this order, and let A(P) be a separating family of convex 
sets. For any i, 1 < % < n, there is a set Ai G A(P) which separates pi and Pi+i, and there is a set 
A n G A(P) which separates p n and p\. These are n sets, and we counted a set at most twice. Therefore, 
A(P) contains at least [n/2] sets, so s(n,V) > [n/2~|. On the other hand, since discs are convex sets, 
s(n,A) < s(n,V) = [n/2]. Therefore, s(n,A) = [n/2]. 

Proof of part (ii). Let ES(k) denote the least integer such that among any ES(n) points in general 
position in the plane there are always k in convex position. In 1935, P. Erdos and G. Szekeres [ES35 
showed that ES(k) exists for every k, and ES(k) < (^Z^) + ^ ^ ne best known bounds for ES(k) are 



they were proved by P. Erdos and G. Szekeres [ES60] . and by Toth and Valtr [TV05| . respectively. 
It is easy to see that both the lower and upper bound holds for n < 16, hence we can assume that 



First we prove the lower bound for s'(n,A). Assume without loss of generality that n is even. Using 
the construction of Erdos and Szekeres [ES6CT, or a subset of it, we can obtain a point set P n of size 
n/2, in general position, such that it does not contain more than 21ogn points in convex position. Take 
a line t which is not parallel to any line determined by the points of P n . Substitute each pont p of P n 
by two points, p' and p" , both very close to p such that the line p'p" is parallel to t. Points p' and p" are 
called twins, and p is their parent. Let Q n be the resulting set of n points, which is clearly in general 
position. 

Suppose that S separates Q n . Clearly, for each pair of twins (p',p") in Q n , there is a set S E S 
which separates them, that is, is contains exactly one of p' and p". Assign such a set S(p',p") to each 
pair (p',p"). 

This way we found n/2 members of S. Now we estimate how many times we could find the same 
set. Suppose e. g. that S(p[,Pi) = S(p' 2 ,P2) = • • • = S(p' k ,p'l). Then, since S is convex, and twins are 
very close to each other and to their parents, points Pi,P2> • • • ,Pk are i n convex position. Therefore, by 
the assumption, k < 2 log n. So, the number of different sets assigned to the twins is at least n/{2 log n). 

Now we prove the upper bound. Again, assume that n > 16. 

By |TV05j . any set of m points in general position contains logm/2 in convex position. Let P be 
a set of n points in general position. We select a separating system S of convex sets such that its 
cardinality is at most 20n log log nj log n by the following procedure. 

Convex- Separate (P) 
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n > 16. 



Let Pi = P, S x = 0, i = 1. 
Step i. Let Qi C Pi be a subset of k = L^fpJ points in convex position. Then there is a family Ai of 
cardinality [log k~\ which separates Qi . 
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Let Si be the convex hull of all points of Qi, and let S[ be slightly shrinked copy of Si (one which 
contains all the points of Pi n Si, except for the points of Qi). 
Add Si, S[, and Ai to S. 

Let -Pj+i = Pi\Qi- If l-Pj+il > \fn, then increase i by one and go to Step i. 
Otherwise, go to Final Step. 

Final Step. For each point p G P, add S(p), a very small disc with center p, to S. 

Stop. 

When we execute Step i, Pi contains more than \fu points, hence, by [TV05j . we can select 
_ |^ logja j ^ io|n p j n ^ g amon g them in convex position. In each step, except for the final one, 
we delete k points, hence we repeat Step i at most 5n/logra times. Each time we select at most 
2 log log n + 2 sets, and in the Final Step we select at most y/n sets to S. So, eventually, we have 
|<S| < lOnloglogra/logn + lOre/logn + \/n < 20nloglogn/logn. We claim that S separates P. We 
have to show that any two elements of P can be separated by some member of S. If p,p' G Qi for some 
i, then Ai separates them. 

Now suppose that p G Qi and p' G" Qi for some i. If p' is in the convex hull of Qi, then Sq from 
Step i separates p and p', if p' is not in the convex hull of Qi, then S' from Step i separates p and p' . 

Finally, suppose that there is no i such that p G Qi. Then we selected set S(p) in the Final Step, 
and it separates p and p' . 

This concludes the proof of Theorem [2j 

Remark. Let A be a family of connected planar sets, 7 a Jordan curve, and k a constant. Suppose 
that each A G A is bounded by a closed Jordan curve, and intersects 7 in at most k intervals. Then, 
it is not hard to see [P12 that s(n,A) > (n — l)/2k. We believe that there is a linear bound for other 
"simple" families, in particular, for families of finite Vapnik-Chervonenkis dimension. 

Conjecture. Suppose that A is a family of planar sets, whose Vapnik-Chervonenkis dimension is finite. 
Then there is a c = c(A) > such that s(n,A) > cn for every n. 

Note that this conjecture has nothing to do with geometry, it is a purely combinatorial statement. 
On the other hand, it might be easier to verify the conjecture if assume that the sets in A are connected, 
or we add some geometric condition. 
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